(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

« International Bureau 

(43) Internationa! Publication Date 
llJuly 2002 (11.07.2002) 




PCT 



(10) International Publication Number 

wo 02/054769 Al 



(51) international Patent Classification^: H04N 7/173 

(21) International Application Number: PCT/US02/00008 

(22) International Filing Date: 4 January 2002 (04.01.2002) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 

60/259,713 



4 January 2001 (04.01 .2001) US 



(71) Applicant (for all designated States except US): THOM- 
SON LICENSING SA. [1^1^]; 48 Quai Alphonse Le 
Gallo, F-92648 Boulogne Cedex (FR). 

(72) Inventor; and 

(75) Inventor/Applicant (for US only): CALVERT, Kerry, 
Wayne [US/US]; 8354 'l\vin Pointe Circle, Indianapolis. 
IN 46236 (US). 



(74) Agents: TRIPOLI, Joseph, S.etal.; Thomson multimedia 
Licencing Inc.. P.O. Box 5312, Princeton, NJ 08540 (US). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 

AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, H, GB, GD, GE, GH, 
GM, HR, HU. ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NO, NZ, CM, PH, PL, PT, RO, RU, SD, SE. SG, 
SI, SK, SL, TJ, TM, TN, TR, TT. TZ. UA. UG, US, UZ. 
VN, YU. ZA, ZM, ZW, 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZM, ZW), 
Eurasian patent (AM, AZ, BY, KG. KZ, MD, RU, TJ, TM), 
European patent (AT, BE, CH, CY, DE, DK, ES, H, FR, 
GB, GR, IE, IT, LU, MC, NL, Pf, SE, TR), OAPI patent 
(BF, BJ. CF, CG, CI, CM, GA, GN, GQ, GW, ML, MR, 
NE, SN. TD. TG). 

[Continued on next page] 



(54) Title: A METHOD AND APPARATUS FOR ACQUIRING MEDIA SERVICES AVAILABLE FROM CONTENT AGGRE- 
GATORS 



OS 
If) 

o 



O 




PlAYBACKOEVICe 



PROGRAM MEMORY 
216 



OAIA MEMORY 
218 



CPU 
214 



SET TOP BOX 
204 



STEREO 
RECEIVER 
206 



TEEVISION 
208 



DATA 
210 



INPUT 




OlSPUY 




AUOIO 


DEVICE 




DEVICE 




SPEAKER 


224 




222 




220 













OUTPUT 
DEVICE 
212 



(57) Abstract: A method for generating a unified list of media 
services available form a plurality of content aggregators having 
different data formats. A first list of media services from a first 
content aggregator (1 02) is transmitted to a playback device (202). 
A second list of media services from a second content aggregator 
(102) is also transmitted to the playback device (202), which com- 
bines both lists into a unified list of media services. The method 
optionally details the playback of a media service from said plural- 
ity of content aggregators via a selection made on the unified list 
to a playback device. 
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A Method and Apparatus for Acquiring Media Services Available from Content 

Aggregators 

[0001] This invention is related to the field of indexing, acquiring, 
5 and playing media services, particularly media services in the form of streaming 
media available from a plurality of content aggregators. 

[0002] Listening to radio broadcast programming, such as music, 
news, and talk shows, is a commonly enjoyed form of media entertainment that 
are typically sent as radio transmissions through the airwaves. 

10 [0003] Radio transmissions have problems that arise due to the 

inherent physical limitations of using radio waves. For example, radio waves lose 
power the further they are from their broadcast source, whereby it becomes 
difficult for a receiver to reliably receive and demodulate a broadcast from a long 
distance. This limitation makes it difficult for listeners to receive their favorite 

15 stations if outside of a geographic region (e.g., a person who lives in Boston 
typically can not receive a radio broadcast from Los Angeles). Additionally, the 
frequencies of radio broadcasts have to be tightly controlled because the 
airwaves can only accommodate a finite number of electronic-magnetic waves 
before interference results. 

20 [0004] The limitations of broadcasting via radio waves are overcome 

by using alternative broadcasting techniques. One approach transmits radio 
station broadcasts as satellite transmissions that are received through a satellite 
dish coupled to an audio decoder. Satellite broadcasts have a further geographic 
range than radio wave based transmissions. Also, satellite transmissions can 

25 accommodate more radio stations broadcasts than broadcasted as radio waves, 
by using techniques as multiplexing and data compression increasing the 
bandwidth efficiency of a transmission. Satellite broadcasts are limited in 
programming choices available, because the radio stations are selected by 
satellite broadcasters and broadcasting via satellite is cost prohibitive, which 

30 may underrepresent the broadcasting choices available from small media 
markets. 
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[0005] 



The amount of programming choices available to a listener (or 



viewer) has increased since the development of radio and video transmissions 
through a communications network such as the Internet. Radio and video 
services (referred to as media services) that were otherwise limited by 
5 geographic bandwidth or other constraints are broadcasted around the world via 
the Internet. Any user who possesses a connection to the Internet and an 
Internet enabled device (computer, cellular phone, MP3 music player, Internet 
appliance, satellite receiver) can receive a media service broadcasted in the form 
of streaming media. The media service is encoded and compressed, typically by 

10 a computer, into packets that conform to a transport protocol, such as TCP/IP. 
The packets are routed to a listener's device through the Internet, in that 
software on the listener's decoding device (e.g., a computer with a media player 
as REALPLAYER™, MACROMEDIA PLAYER™, and MP3PR0™) decompresses and 
decodes the packets into an audio/video signal for playback on an output device 

15 (computer, receiver, stereo, television set). 



thousands of media services. The music genres available to a user are equally as 
expansive, as a user can select to hear a sub-genre of a music genre (e.g., a rock 
and roll station "music genre" that plays 1980's new wave music "sub-genre"). 

20 The listener also can manipulate the songs (media objects) or content heard into 
a playlist, which is organized by the preferences of the listener. These 
broadcasts are accessed choosing a link (uniform resource indicator URI) to a 
music file on a website or by using a media player that receives streaming feeds 
of media services. Within all of these customizable options, it is difficult for a 

25 user to find all of the media services available because the content on the 
Internet is chaotically organized. 



through the Internet is the use of a tuning service or a media subscription 
service. These type of services (alternatively known as content aggregators), 



30 such as MUSICMATCH~, LIVE365™, and STREAMWAVES™ bring together a 
plurality of media services to a common point or interface (e.g., a website, a 



[0006] 



The Internet provides a listener with the ability to access 



[0007] 



One development for organizing media services available 
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streaming media player with channels) with an architecture where a user selects 
media services from categories including genre and performer. A tuning service is 
typically proprietary to protect the copyrighted material comprising media 
services and requires an interface to successfully use the tuning service to 
5 playback an available media service. The restrictions of using a proprietary tuning 
service typically limits a user from activating media services available from 
different content aggregators, without switching to an additional device. 

[0008] In accordance with the principles of the present invention, a 
method and apparatus are disclosed that enable the indexing and acquisition of 
10 media services from a plurality of content aggregators. A listing of media 
services is generated by the indexing of available media services from the 
plurality of content aggregators. The method and apparatus also describe the 
retrieval and output of a selected media service available from the plurality of 
content aggregators to a playback device. 

15 

Brief Description of the Drawings 



[0009] FIG. 1 is a diagram of audio and video based media services 
that are aggregated by a content aggregator. 

20 [0010] FIG. 2 is a diagram of an Internet connection between 

devices using the invention and a plurality of content aggregators. 

[0011] FIG. 3 is a flowchart of formatting a request to a content 
aggregator. 

[0012] FIG. 4 is a block diagram of requesting a content list from a 
25 content aggregator. 

[0013] FIG. 5 is a diagram of audio based media services available 
from a plurality of content aggregators indexed into a unified content list. 

[0014] FIG. 6 is a block diagram of requesting and acquiring a media 
service from a content aggregator. 
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[0015] FIG. 7 is a flowchart of a synchronous usage model 
requesting and acquiring music services from a content aggregator 

[0016] FIG. 8 is a diagram of requesting and acquiring music services 
from a plurality of content aggregators by using a control point. 

5 [0017] FIG. 9 is a diagram of a content list of media services a 

playback device receives from a content aggregator as computer code. 

[0018] FIG. 10 is a diagram of a content list of media services 
formatted to the internal data structure of a playback device by a content 
adapter. 

10 [0019] FIG. 1 1 is a display of a content list of media services 

formatted into a menu by a XML parser. 

[0020] In FIG. 1, a composition of media services available to a 
content aggregator 102 is shown. Audio based media services, as audio website 
104, radio station 106, music service 108, originating as audio based feeds 

15 (e.g., music, talk radio show, streaming media files, baseball game, audio from a 
television program, audio books), and video station 109 (e.g., CNN®, ABC®, 
DIRECTV®) are media services available to content aggregator 102 through 
communications network 110 (e.g., Internet, Public Switched Telephone 
Network (PSTN), Local Area Network (LAN), wireless network. Digital Subscriber 

20 Line (DSL), peer to peer network). Preferably, the media services are coupled to 
content aggregator 102 via communications network 1 10 with the media 
services transmitted as packets conforming to a TCP/IP protocol. Optionally, 
content aggregator 102 receives audio and video feeds that are transmitted 
through a wireless interface (radio frequency, microwaves, infrared) or receives 

25 media objects (e.g., audio-video files that are pre-recorded or real time feeds 
transmitted as streaming media) that are stored locally at the site of the content 
aggregator 102 (such as in a hard disk drive, optical storage, removable storage 
device, or magnetic tape). 
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[0021] The media services available for transmission comprise audio 
and video feeds. Audio website 104 is an Internet based website that comprises 
audio based media services that are transmitted in the form of streaming media 
or are computer files partially or completely transmitted. Optionally, the media 
5 services may purport to a type of media file format (e.g., REALAUDIO®, 

REALMEDIA® APPLE QUICKTIME®, MICROSOFT® WINDOWS MEDIA™ FORMAT, 
MPEG-2 LAYER III AUDIO, and MP3®) that is played back via a media player 
(REALPLAYER®, WINAMP®, and MICROSOFT® WINDOWS MEDIA™ PLAYER). 
Radio station 106 is a content provider that broadcasts radio programs as audio 

10 based streamed media services. The broadcasts may be live or prerecorded. 
Music service 108 is a media service that is subscription based (e.g., MUSAK®, 
MUSIC CHOICE®') that broadcasts programming as an audio based media service 
available through the content aggregator 102. Video feed 109 is a media service 
that is transmitted from a television station (e.g., CNN, ABC ) or as a video 

15 service (e.g., a movie on demand) available to content aggregator 102. 

[0022] In accordance with the principles of the present invention, 
content aggregator 102, in an alternative embodiment, exists as a web resource 
(e.g., website, index, catalog) that comprises Uniform Resource Indicators (URIs) 
that link to the location of media services. A playback program (e.g., a 
20 streaming media player) directly accesses a media service at its listed location 
(by using the listed link) instead of receiving the media service directly from 
content aggregator 102. Content aggregator 102 may comprise an index of links 
to the location of media services and may have media services that are 
transmitted directly from content aggregator 102. 

25 [0023] Uniform resource indicators (URIs) are a universal set of 

names that refer to existing protocols or name spaces that identify resources 
(e.g., website, streaming media server,), services (e.g., videos on demand, 
internet radio), devices (e.g., mobile phone, internet enable appliance), and data 
files (e.g., media files and text documents). A URL is a form of a URI that 

30 expresses an address that maps to an access algorithm using network protocols 
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(e.g., TCP/IP or a MPEG transport scheme). When a URL is used, a specific 
resource, service, device, or data file may be accessed and/or manipulated. An 
alternative form of a URI known as an Internet protocol number or address (IP) is 
a series of numbers that refers to a specific resource, service, or data file. 
5 Optionally, a URL is mapped to an IP number, typically through a Domain Name 
Server (DNS), that provides two ways to access a desired resource (e.g., a 
resource is accessed either by using the domain name www.whitehouse.gov or 
the IP address 198.137.240.91). 

[0024] FIG. 2 illustrates a connection between Internet enabled 
devices (a playback device 202, cable set top box 204, computer, cellular 
phone, MPS player, video game system) and a plurality of content aggregators. 
Content aggregator 1 02 receives audio based media services from audio website 
104 and radio station 106. An Internet enabled device, such as playback device 
202, accesses content aggregator 102 via a communications network 1 10 (e.g., 
Internet). 

[0025] Playback device 202 communicates with content aggregator 
1 02 to request a listing of media services available from content aggregator 1 02 
and to receive media services selected from the list of media services. 
Preferably, the communications are procedural calls and requests comprising 
20 computer commands, for example hypertext markup language (HTML) or 
extensible markup language (XML) based requests, transported as packets 
adhering to a transport structure (e.g.. Transmission Control Protocol/ Internet 
Protocol (TCP/IP)) through communications network 110. The procedural calls 
are formatted through the use of an application programming interface (API). 
25 This interface comprises a series of functions that are used by a program or 
device to initiate a specific action (for example, an Internet enabled device uses 
an audio API to control a soundcard for the playback of an audio based media 
service). 

[0026] Playback device 202, as an Internet enable device, contains 
30 hardware and software (APIs and program subroutines) for communicating and 



10 



15 
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interacting with content aggregator 102. Preferably, playback device 202 
comprises central processing unit (CPU) 214, program memory 216, data 
memory 218, an audio speaker 220, display device 222, and input device 224. 
CPU 214 (a computer processor) processes audio services received from the 
5 content aggregator 102, received via communications network 1 10. CPU 214 is 
coupled to data memory 218 that stores data received from the content 
congregator 102 and selected media services. Program memory 216, connected 
to CPU 214, stores programming instructions and APIs used to communicate 
with and process the media services obtained from content aggregator 102. 

10 [0027] Display device 222 displays the program genres and sub- 

genres of audio based media services available from content aggregator 102. 
Preferably, display device 222 is a television display, LED display, or LCD 
display. The genres and sub-genres are selected by using input device 224 by 
engaging a button, dial, or touch screen interface, or other tactile mechanism 

15 available on input device 224. CPU 204 requests (via a command such as a 
computer command or a procedural call) an audio based media service (in this 
example from a radio station 106) through content aggregator 102, after the 
media service was selected via input device 224. Content aggregator 102 
receives the request from playback device 202 and, in response, sends the 

20 selected media service to playback device 202 in the form of a packetized 

transmission. Playback device 202 processes the media service and outputs the 
results through connected audio speaker (loudspeaker) 220. In an alternative 
embodiment, the selected media service is video based and is outputted to 
display device 222. 

25 [0028] Set top box 204 is an Internet enabled device that receives 

audio and video based media services from, for example, cable or broadcast 
television stations. Preferably, set top box 204 is a conduit for media services 
that are multi-threaded or multiplexed by set top box 204 to devices that are not 
Internet enabled (e.g., stereo receiver 206 and television audio output 208). For 

30 example, set top box 204 receives a classical music based media service, which 
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set top box 204 sends to stereo receiver 206. At the same time, set top box 
204 receives a newscast media service that is transmitted to coupled television 
208. Optionally, set top box 204 transmits audio services to an attached data 
network 210 (e.g., Ethernet network, wireless RF network, power line based 
5 network, or infrared network) that is connected to output device 212 (connector 
or audio speaker) that outputs the media services as a signal. 

[0029] Multi-threading operates by set top box 204 dividing up its 
processing tasks (housekeeping tasks, data retrieval, processing data, outputting 
data) into a number of timeslots. Each processing task is allocated a number of 

10 timeslots. Processing tasks of a high priority (playback of a media service) 
receive a larger number of timeslots than other processing tasks (updating the 
display of available media services). The times slots as allocated in accordance 
with a predetermined procedure. In the current example, set top box 204 divides 
each second into ten timeslots: four timeslots are allocated for the classical 

15 music media service, four timeslots are for the newscast media service, and the 
remaining two timeslots are for housekeeping procedures. Set top box 204 then 
processes the media services and performs housekeeping tasks in accordance 
with the timeslots allocated. An embodiment of the invention supports that time 
slots durations may be unequal or equal amounts of time. 

20 [0030] FIG. 3 shows a flowchart of a method of configuring a device 

(playback device 202 or set top box 204) to the same data format as content 
aggregator 102 for acquiring and outputting selected media services. In the 
preferred embodiment, playback device 202 communicates with a content 
aggregator 102 through communications network 1 10 in accordance with 

25 computer instructions controlling the CPU 214. The computer instructions 

comprising an API operating through specific procedural calls. The API requests 
parameters from content aggregator 102 via a Set_Service_Call in step 302. The 
parameters transmitted to playback device develop a data and communication 
structure used by playback device 202 to communicate with content aggregator 

30 102. The communication structure is the format used to communicate data 
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between playback device 202 and content aggregator 102. Preferably, the 
playback device 202 conforms with TCP/IP, Open Systems Interconnection (OSI) 
protocol, 3G, or WAP based transport protocols architectures. Accordingly, 
playback device 202 determines the communications structure of content 
5 aggregator 102 by using a handshake process and receiving data back that 
comports to a predetermined communications structure. Also, playback device 
202 passively receives a data stream from content aggregator 1 02, whereby 
playback device 202 determines the communication structure based upon key 
attributes that exist in the data stream. For example, playback device 202 reads 
10 a header of a received data packet and determines that the data packet comports 
to a MPEG transport and data scheme. 



service menus, the locations (URIs) and types of media service formats (Real 
Audio, Microsoft Media Player, MPS) available from the providers of the media 

15 services that correspond to a style sheet Playback device 202 receives the style 
sheet from content aggregator 1 02 and formats incoming and outgoing data 
accordingly. Preferably, the determination of data structure comprises a 
document object model (DOM) comprising three levels. Level 1 establishes the 
format governing the exchange of data (e.g., XML and HMTL). Level 2 controls 

20 presentation and manipulation of data being transmitted (using style sheets). 
Level 3 defines a content model (e.g., data variables and metadata fields) and 
events used for a document (function key F12 saves a document). Optionally, 
Multipurpose Internet Mail Extensions (MIME) compliant classes and object types 
are used to define the objects available. Playback device 202 stores data 

25 structure parameters from content aggregator 1 02 into the program memory 
216, in step 304, and formats future communications with the content 
aggregator 102 accordingly. 



new document types and media formats as multimedia standards adjust. For 
30 example, a new content aggregator uses a new multimedia player to play back 



[0031] 



For example, a sample data structure comprises media 



[0032] 



The use of a DOM allows playback device 202 to support 
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available media services. Playback device 202, when requesting a media service 
from the new content aggregator, will read the corresponding DOM and locate 
the new multimedia player (either by a embedded locator in the DOM or by 
referring to an external database). Playback device 202 then requests a codec 
5 (update) for the new media player, which is stored once the codec is received. 
The media service is ready to be outputted by playback device 202 using the 
new media player. 

[0033] With the data structure parameters stored, playback device 
202 requests a content list of media services from content aggregator 1 02 via a 

10 List_Content_Cdll issued by CPU 214, .in step 306. As displayed in FIG. 4, the 
List_Content_Call comprises an Iradio API 412 that initiates an Iradio Request 
API 402 (stored in program memory 216) that allocates and manages the internal 
resources used for the content list request. Preferably, CPU 214 designates 
operational cycles for the content list request and designates space in the data 

15 memory 21 8 for the storage of a content list. Optionally, Request API 402 
manages multiple requests for content lists from a plurality of content 
aggregators 102, simultaneously. 

[0034] CPU 214 then issues a HTTP processor API 404 subroutine 
that controlling the communication transmissions with content aggregator 102. 

20 HTTP processor API 404 functions in accordance with the parameters stored in 
step 302 by managing the connection, communications, and HTTP protocol 
exchange with the content aggregator 102, This includes all processing related 
to HTTP URI redirection, error recognition, and response classification as a 
standard response to a stream comprising a media service. HTTP processor API 

25 404 transmits the content list request to content aggregator 1 02 via 

communications network 110. Content aggregator 102 responds by transmitting 
a content list of available media services received through HTTP processor API 
404. 

[0035] After receiving the content list, preferably in a predetermined 
30 format, CPU 214 initiates content adapter 406 routine that formats the received 
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content list to an internal format of data and an internal data structure used by 
playback device 202. For example, CPU 214 uses a XML (internal format of 
data) based document type definition (DTD) that predefines the internal data 
structure (data fields) used for playback device 202. Data received from the 
5 content aggregator 1 02, in a XML format, is directly matched to the data fields 
defined by the DTD. If the data received from content aggregator 102 does not 
comply with the internal data format (XML), content adapter 406 formats the 
data into XML, preferably by the use of translation tables, and associates the 
formatted data into the internal data structure (DTD) of playback device 202. 
10 Optionally, the formatted data and data received from content aggregator 102 
are stored in data memory 218. Also, the DTD is updateable (for example, an 
update sent as a style sheet via the Internet 110 overwrites an existing DTD). 

[0036] XML parser 408 receives the XML based data from the 
content adapter 406 (or from the data memory 218), and maps the XML based 
15 data to preselected menu elements that are displayed and manipulated by a user. 
The data mapping accomplished via a data table that indicates which variables 
from the internal data structure are mapped to preselected menu elements. 

[0037] FIG. 9 is a diagram of a content list of media services 900 (in 
XML format) the playback device 202 receives from content aggregator 102. 
20 FIG. 10 is a display of a content list of media services 1000 formatted to the 
internal data structure of the playback device 202 by the content adapter 406. 
FIG. 1 1 is a display of a content list of media services 1 100 formatted into a 
menu by the XML parser 408. 

[0038] As an exemplary embodiment, data formatted by the XML 
25 parser 408, is displayed as a hierarchical menu on display device 222. The 

hierarchical menu lists fields that are either preselected or designated by a user 
(sample fields are media service, title, media type, performer, content aggregator 
source, etc.). For example, a "top" level of the menu is displayed by genre (e.g., 
talk show, music, news, sports talk, mystery, soap opera, etc.). When a user 
30 selects a genre listed on the "top" menu level via input device 224, content data 
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procedure 410 initiated by CPU 214 checks data memory 218 if there are any 
sub-genres or available media services listed in association with the selected 
genre. Alternatively, content data procedure 410 issues an additional content list 
call 401 to content aggregator 102 for more information that is associated with 
5 the selected genre (repeating the steps discussed above). Content data 

procedure 410 generates and displays from the associated data a "second" level 
menu listed underneath the "top" level. The user then makes a selection from 
the "second" level, and content data procedure 410 continues to issue content 
list calls 401, until the user selects a media service for playback. 

10 [0039] After a media service is selected via input device 224 (e.g., 

from a hierarchical menu or a listing of available media services), CPU 214 issues 
an lradio_Stream_Contents_call API, in step 308, to retrieve the selected media 
service from the content aggregator 102. The lradio_Stream_Contents_call API, 
as displayed in FIG. 6, begins with a Stream Request Call 602 that determines a 

15 location of the requested media service (preferably the media service's URI) 
either through data returned from the lradio_List_Content_Call (in data memory 
218) or through other means (e.g., as requesting the location of the media 
service from the content aggregator 102). Optionally, 

lradio_Stream_Contents_call API 308 supports asynchronous (multiple) requests 
20 for media services via the multithreading capability described above. 

[0040] Once the location of the selected media service is known, the 
CPU 214 issues an Iradio API 412 that starts with the Request API 402 
subroutine for allocating and managing resources used for the Stream Request 
Call 602. HTTP processor API 404 is issued, as part of Iradio API 41 2, to 

25 connect to the location of the selected media service via the communications 
network 110. The connection to the location of the media service is a direct 
connection (website, storage device, cellular network, etc.), a connection made 
through content aggregator 102 to the location of the media service, or a 
connection that is redirected to the location of the media service. HTTP 

30 processor API 404 also manages the details of locating stream data in the 
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response that comes from the requested media service's location. The request 
for a media service is preferably made as a HTTP or MIME compliant request 
containing information about the resources required to playback the media 
service (such as a media player). Along with standard HTTP redirect processing, 
5 HTTP processor API 404 analyzes the HTTP response header to determine 

whether the response Is a stream, media file, or other type of multimedia format 
(e.g. a REALPLAYER® based stream, a non-streamed MPS file, or a video signal). 
Once the determination is made, HTTP processor API 404 accepts data 
comprising the selected media service. 

10 [0041] As the data comprising the media service is transmitted to 

playback device 202, HTTP processor 404 routes the data to buffer 604 
(contained in data memory 218). Buffer 604 preferably outputs data in a first in 
first out (FIFO) scheme. Optionally, buffer 604 comprises a plurality of memory 
banks that queue data in accordance with a predetermined method (e.g., shared 

15 memory, memory interleaving, memory address cycling, etc.) enabling the 

request and delivery of multiple media services via the multithreading capability 
discussed above. 



comprising the media service that is stored in buffer 604. Preferably, the 
20 processing of media service data depends upon information that is contained in 
the response header or footer of the media service data (e.g., indicating the 
format of the media service, the corresponding playback application 608, output 
requirements of the media service). Processing examples performed by the 
content adapter 406 include decompressing the data, analyzing metadata in the 
25 media service data (e.g., metadata that describes the media service), or applying 
preselected audio or video effects. 



application 608 (media player) that outputs or "plays" media service data in, step 
310. The player application is a media complaint decoder (e.g., REALPLAYER, 
30 MPEG-1 Layer.3, MICROSOFT MEDIA PLAYER, QUICKTIME, MPEG-4, DivX) that 



[0042] 



Content adapter 406 accesses and processes the data 



[00431 



The media service data, once processed, is sent to player 
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decodes the media service data into a decoded audio/video signal that is ready 
for output to a media device (e.g., audio speaker, video screen, audio/video 
receiver, transmission device). 

[0044] Player application 608 will keep playing the media service 
5 until the content adapter 406 runs out of data received from buffer 604 (starting 
playback of another media service), or the media service is terminated via a 
return code in step 312, whereby the media service is told to stop transmitting. 
Preferably, the return code is issued from content adapter 406 to HTTP 
processor 404 that sends a "cancel" command to the location of media service 

10 via the communications network 1 10 to terminate the transmission of media 

service data. The return code results from sources including, as examples, a user 
issuing a cancel command, an overflow/underflow error, not enough available 
memory, network congestion, output device not connected, etc. Optionally, CPU 
214 has diagnostic circuitry that recognizes an error that results in the 

15 cancellation of the transmission of a media service via a return code. 

[0045] As described above, an embodiment of the invention breaks 
up the processing demands of service requests, I/O (Input and Output) routines, 
and data conversion into distinct threads. The threads are dynamically 
categorized and allocated computer resources (by a predetermined method), in 
20 order to fulfill desired requests and housekeeping routines for the invention. The 
benefit of this approach is that requests can be processed by a system in 
accordance with this invention simultaneously, without the conflicts or delays 
induced by the processing of other requests. 

[0046] In addition, the use of threads to process API requests allows 
25 application designers to choose whether or not they want to use synchronous or 
asynchronous interfaces to implement API services. This feature provides for 
APIs to be implemented within a vast majority of programs without forcing 
application designers to develop infrastructure around the API for managing its 
service characteristics. 
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[0047] The threads communicate with each other via a unique 
memory buffer queue that resides in data memory 218. The threads put and 
retrieve buffers (in data memory 218) from named queues, and when done with 
a buffer, release the buffer to a buffer pool comprising a plurality of buffers. The 
5 buffer queue enables the invention to designate specific threads to specific 
buffers, optimizing the storage and access of media service data when 
processing multiple media services. 

[0048] Access to the memory buffer queue's data structure is 
protected by semaphore primitives, which may be implemented as a binary flag. 

10 The use of semaphore primitives allow for the media service data to be shared 
across threads without corruption of the data management structures. For 
example, when a thread requests a buffer from the memory buffer queue, all 
management of data structures that track the queue buffer are performed after 
locking a semaphore primitive that guarantees exclusive access to the data 

15 structures. 

[0049] Queue retrievals of data from the memory buffers (in data 
storage 218), supports both a blocking and a non-blocking mode. In the blocking 
mode, the thread will stop processing and wait on the buffer to be presented, 
which could be an indeterminate amount of time. This blocking mechanism 
20 allows CPU 214 resources to be balanced across the threads. For example, the 
content adapter will process a buffer and send the buffer to the player 
application via a queue that empties the buffer. When the buffer is waiting to be 
filled, the content adapter will ignore (block) the buffer until it is filled by the I/O 
thread, freeing up the content adapter to access other filled buffers. The non- 
25 blocking mode accesses a memory buffer whether it is filled or empty (reducing 
the content adapter's efficiency), 

[0050] As described in step 310, the invention optionally operates in 
a synchronous or asynchronous mode. Preferably, in accordance with the 
principles of the present invention, the asynchronous mode operates with 
30 callback functions, whereby the CPU 214 initiates a process (API) and 
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designates the process to a specific thread. CPU 214 also designates a 
corresponding callback function for the procedure that terminates the procedure 
(API) when the callback function is returned to CPU 214. For example, when an 
lradio_List_Content_Call 306 (requesting a list of media services) is initiated by 
5 CPU 214, a thread and a callback function are issued by CPU 214 that 

corresponds to the procedure. As the thread corresponding to the procedure is 
executed, the callback function is passed to a pointer that responds to a 
predetermined condition specified for the procedure (e.g., the transmission of the 
content list from content aggregator 102 triggers the callback function back to 
10 CPU 214). During this time, additional procedures run on other threads. The 
pointer, after the condition is met, issues a callback function to CPU 214 that 
terminates the thread executing the procedure. 



callback functions. The functionality is the same of the asynchronous mode, but 
15 only a single (current) procedure is run at a time, effectively blocking all other 
procedures until the current procedure is serviced or an error results (terminating 
the current procedure). CPU 214 begins a "new" procedure after the current 
procedure terminates and memory space in data memory 218 is cleared with a 
release command (ReleaseRespond). 

20 [0052] FIG. 7 displays an embodiment of the invention for combining 

the list of media services available from two content aggregators 102. Step 702 
begins with a request for a list of media services by CPU 214 to a first media 
content aggregator. CPU 214 executes an lradio_Set_Service call that builds a 
set of commands used to access first content aggregator 1 02 (in accordance 

25 with FIGS. 3 and 4 described above). A follow-up lradio_Content_List call is 
assigned to a thread for processing, freeing CPU 214 for other processing tasks. 
First HTTP processor API 404 receives the thread and initiates the retrieval of 
the list of media services from first media content aggregator 102. 



30 available from a second media content aggregator 102. CPU 214 executes a 



[0051] 



Alternatively, the synchronous usage model does not utilize 



[0053] 



Step 704 entails a request for a second list of media service 
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second Iradio Set Service call that builds a set of commands for accessing 
second content aggregator 102 (in accordance with FIGS. 3 and 4 described 
above). An lradio_Content_List call is then assigned to a second thread, which is 
received by second HTTP processor API 404 that accesses and retrieves the list 
5 of media services from second content aggregator 104. Optionally, the first and 
second HTTP processor API 404 are the combined into one HTTP processor unit 
404, which may be contained within CPU 214. 

[0054] In Step 706, the first HTTP processor API 404 performs a 
Get command (e.g., HTTP Get Command) used to request the list of media 
10 services from first content aggregator 102. Preferably, the Get command is 
transmitted as a HTML or XML based request. 

[0055] Step 708 involves the response to the Get command by first 
content aggregator 102, Preferably, first content aggregator 102 transmits a list 
of media service to first HTTP processor API 404 that determines the integrity of 

15 the list {e.g., does the list comply with a format recognized by first HTTP 

processor API 404?). Alternatively, if the list of media services is corrupted, the 
Get command (in step 706) is repeated a predetermined number of times, before 
first HTTP processor API 404 times out and returns an error message to CPU 
214. In Step 710, first HTTP processor API 404 collects data comprising the list 

20 of media services from first content aggregator and forwards the list to content 
adapter 406 for additional processing. 

[0056] Step 712, content adapter 406 receives the list of media 
services and invokes the appropriate transformation routine (e.g., converting the 
received list into the internal format of the invention via lookup tables) to create 

25 a common (internal) content list data structure containing genres and sub-genres 
of media services. This common content list may be used to generate a viewable 
list of media service that is displayed on display device 222. Preferably, the 
genres and sub-genres of media services are determined by metadata within the 
list of media services, or by matching the metadata to an external database (e.g., 

30 CDDB™ and MUZE™). In accordance with the principles of the present invention. 



wo 02/054769 PCTAJS02/00008 

18 

media services may be grouped by information (metadata) such as: media service 
author, date of copyright, media service date of transmission, performer, title, 
subject, parental rating, user rating, director, producer, running length, media 
service transmission locator (e.g., radio station, television station, studio, etc), 
5 content aggregator subscription, and language. 

[0057] In Step 714, CPU 214 repeats steps 706-712 for a second 
list of media services available from second content aggregator 102. A second 
HTTP processor API 404 requests the second list of media services via a Get 
Command (step 706). The second content aggregator 102 responds to the Get 

10 command (step 708). The second HTTP processor API 404 collects the list of 
media services from second content aggregator 1 02 and forwards the second list 
to content adapter 406 for additional processing (step 710). Content adapter 
406 uses the common list data structure to match the media services listed in 
the second content list to genres and sub-genres of media types. The contents 

15 of the first and second content list are then indexed into a unified content list, 
for example under common music genres as shown in FIG. 5 or other types of 
hierarchical listings using metadata attributes, as described above. 

[0058] The unified content list is presented to the user on display 
device 222. Each item in the unified content list has a content identifier that 
20 uniquely identifies the content and its source. Content adapter 406 passes this 
identifier to CPU 214 when a media service is selected for retrieval. CPU 214 
then retrieves and plays back the media service, in accordance with the method 
described in FIG. 6 above. 

[0059] An example of merged content selections in the form of a 
25 unified list is displayed in FIG. 5. The genres and the sub-genres of media 
services available from the content aggregators are downloaded into data 
memory 218, and are manipulated preferably by a subroutine of the XML parser 
408. For example, a first content aggregator 102 has a listing of media services 
510 grouped by music genres and related sub-genres (e.g.. Jazz, a music genre, 
30 has the sub-genres of Brass, Suncoast Sound, and Trios). Second content 
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aggregator 102 has a listing of media services 520 grouped by music genres 
with related sub-genres (e.g., Jazz, a music genre, with the sub-genre of Acid 
Jazz). XML parser 408 groups the related genres together and into a format 
shown in unified content aggregator list 530 (e.g.. Jazz has the combined sub- 
5 genres from the two content aggregators being Acid Jazz, Brass, Suncoast 
Sound, and Trios). This format is then outputted to display device 222, and the 
music services are selected via input device 224 for playback through audio 
speaker 220. 

[0060] FIG. 8 describes an exemplary embodiment of the invention 

10 that allows for a device connected on a network to control and receive 

secondary media services available through content aggregator 1 02. The device 
connected to the network conforms to a predetermined protocol (e.g.. Universal 
Plug and Play, IEEE 802.1 1 , BLUETOOTH®, IEEE-1 394) permitting the device to 
recognize and utilize features of other equipment on the network that conform to 

15 the predetermined protocol. A primary media service is a media service that 
natively exists in a device, for example external device 820 (a stereo receiver) 
plays audio received as radio waves received through antenna 822 that are 
demodulated by tuner 824 for playback through audio speaker 818. A secondary 
media service is a media service that originates in other equipment that is 

20 accessed and controlled through a network connection by a device on the 
network; for example receiver 820 receives and controls a streaming audio 
broadcast (secondary media service) from content aggregator 1 02 through cable 
set top box 204. In this example, the set top box 204 offers the secondary 
media services as ContentDirectory 806 services (hardware or software that lists 

25 the available media services) that are indexed and managed through the 
operation of the predetermined protocol. 

[0061] Receiver 820 communicates via the predetermined protocol 
to set top box 204 through a network or wireless connection. Set top box 204 
also connects to content aggregator 102 through communications network 1 10, 
30 whereby content aggregator 102 has secondary media services (e.g., streaming 
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audio and video, MPS, compact disc music, broadcast video) available. 
Preferably, content aggregator 102 communicates to set top box 204 through a 
TCP/IP based connection through hardware services module 802. Hardware 
services module 802 is a modem or other type of bi-directional communications 
5 device with serial, parallel, Ethernet, or other connecting interface. Hardware 
services module 802 also controls the video programming displayed on television 
208 connected to set top box 204. 

[0062] Control point 810, a controller (e.g., computer, 
microprocessor, or software driver) connected to set top box 204, requests a 

10 listing of media services available from content aggregator 102 through set top 
box 204. This request is received by ContentDirectory 806 that in turn issues a 
List_Content_Call (from step 306) to the stream API 804, as described above in 
FIG. 4. Optionally, set top box 204 receives listings of media services from a 
plurality of content aggregators 102 preferably as XML or HTML based 

15 documents. The listing of the media services received by stream API 804 is 
processed and transferred to the ContentDirectory services 806. Additionally, 
the ContentDirectory service 806 formats the listing of media services from XML 
in accordance with a predetermined format and indexes the listing for access by 
other equipment that conform to the predetermined format. 

20 [0063] Control point 810 transmits a command to set top box 204 

to display the available media services on a display device (television 208). The 
control point 810 uses the display services routines of the predetermined 
protocol and requests the list of media services from set top box 204. Also, set 
top box 204 takes delivery of the request and transfers the listing of media 

25 services residing in the ContentDirectory services 806. Control point 810 
receives and formats the media service list as HTML code that is sent to 
hardware services 802 that renders the HTML for display on connected 
television 208. Preferably, the rendered HTML code is displayed as a 
combination of text and graphics that may be used as an electronic programming 

30 guide, as in FIG. 1 1 described above. Control point 810 is also enabled to control 
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and transmit other services 808 such as additional media services, or Internet 
based material that does not come from content aggregator 102, such as an 
electronic program guide, electronic mail, and purchasing a selected media 
service (as a CD or cassette tape) through an online store via user selection 
5 device 826. 



listing of media services via user selection device 826 that transmits signals to 
control point 810. Preferably, user selection device 826 is remote control that 
uses a wire or wireless interface to communicate with control point 810, 
10 whereby television 208 displays the listing of the media services by a use of a 
directional pad, buttons, or knob on user selection device 826. Once a media 
service is selected with user selection device 826, control point 810 formats and 
sends a request for the media service to a content aggregator 1 02 via hardware 
services module 802 and communications network 1 1 0. 

1 5 [0065] Content aggregator 1 02 receives the request for the media 

service and after processing the request, transmits data comprising the media 
service to hardware services 802 through communications network 110. 
Hardware services 802 receives data that transferred to stream API 804 that 
formats the data of the media service to an internal format utilized by set top 

20 box 204. 



comprising the media service by transmitting a request to AV transport 812 to 
output the media service to receiver 820. Preferably, AV transport 81 2 
comprises a connection interface to an external device (as receiver 820). 

25 Optionally, AV transport 812 comprises software that controls the transmission 
of data (forming the media service) residing in buffers of the stream API 804. AV 
transport 812 receives (from the stream API 804) and formats the data 
comprising the media service (into predetermined signal format for output to the 
receiver 820. The signal is outputted through the connection of the AV transport 

30 81 2 to receiver 820. AV transport 812 continuously queues the buffers of 



[0064] 



From television 208, a media service is selected from the 



[0066] 



Control point 810 coordinates the outputting of the data 
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stream API 804 until the media selection is completely received or a user 
terminates the play of the selection. 

[0067] Receiver 820 (e.g., an audio receiver) receives the output 
signal through AV transport 814 via the connection interface with set top box 
204. AV transport 814 forwards the signal to hardware services 816 for 
processing. Hardware services 816 then transfers the processed signal to audio 
speaker 818 for audio playback. Optionally, the external device has built in tuner 
824 that receives RF based radio signals from antenna 822. Tuner 824 
demodulates and decodes radio signals for playback on the connected audio 
speaker 818. The external device automatically interrupts the playback of tuner 
824 when hardware services 816 receives and outputs the processed signal. The 
playback of the radio signals received through tuner 824 is resumed when the 
selected media service is terminated or completed. 

[0068] In accordance with the principles of the present invention, 
forms of other delivery systems delivering media services available from content 
aggregators may benefit from the present invention. For example, a satellite 
radio broadcast with multiple media services available may have its selections 
combined with the available media services through a set top box cable 
interface, to form a unified listing of media services. 
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CLAIMS 

1 . A method of processing media services from a plurality of content 
aggregators through a communications network comprising the steps of; 

receiving a first media service list from a first content aggregator from a 
5 plurality of content aggregators, 

receiving a second media service list from a second content aggregator 
from said plurality of content aggregators, wherein said second media service list 
has a data structure incompatible with a data structure said first media service 
list; and 

10 translating said first media service list and said second service list into a 

unified media service list comprising media services available from a plurality of 
uniform resource locators. 

2. The method of claim 1 further comprising an additional step of 
15 displaying said unified media service list. 

3. The method of claim 2 further comprising additional steps of: 
requesting a media service displayed on said unified media service list, 

wherein a location of said media service is identified by a corresponding uniform 
20 resource locator from said plurality of uniform resource locators; 
receiving said media service; and 
outputting said media service. 

4. The method of claim 3, wherein said media service is output from a 
25 device comprising at least one of: a portable audio device, a stereo, an Internet 

radio, a computer, a telephone, an Internet enabled device and a memory device. 

5. The method of claim 3, wherein said output comprises a function 
selected from at least one of: playing, copying, and transmitting said media 

30 service to a playback device. 
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6. The method of claim 3, wherein said media service is in a format 
comprising at least one type of media extension from the group of: .ram, .rm, 
.rpm, .mov, .qif, .wma, .cmr, .avi, .swf, .swi, .mpg, .mpa, .mpl, .mp2, .mp3, 
.mSa, and ,m3u. 

7. The method of claim 1, wherein the data structure of said first content 
aggregator is defined by a document type definition (DTD). 

8. The method of claim 1 , wherein said plurality of content aggregator 
comprises at least one of a website, a server, a web-enabled device, a radio, a 
data storage device, an on-demand subscription service, tuning service, peer to 
peer media service, and a broadcast service. 

9. The method of claim 1 , wherein said unified media service list is the 
same data structure of at least one of: said first media service list, and said 
second media service list. 

10. The method of claim 1, wherein a third media service list is translated 
and merged in said unified media service list. 

1 1 . The method of claim 2 wherein said unified media service list is 
organized by at least one of: a genre of said media service, a media service 
author, a copyright data, a media service date of transmission, a performer, a 
title, a subject, a parental rating, a user rating, a director, a producer, a running 
length of said media service, a media service transmission locator, a subscription 
service, and a language. 

12. The method of claim 3, wherein said media service is from a content 
aggregator from said plurality of content aggregators. 



wo 02/054769 PCT/US02/00008 

25 

13. The method of claim 3, wherein said media service is received from a 
location associated with a content aggregator from said plurality of content 
aggregators. 

5 14. A method of processing received media services from a plurality of 

content aggregators, comprising the steps of: 
selecting a first media service; 
selecting a second media service; 

processing said first media service and said second media service by a 
10 device; 

outputting said first media service to a first playback device, and 
outputting said second media service to a second playback device, 
wherein said outputting of said first and second media services is simultaneous. 



15 15. The method of claim 14, wherein said steps of outputting to said first 

and second playback devices comprises at least one of playing, copying, and 
transmitting a stream to said first and second devices, respectively. 

16. The method of claim 14, wherein said first playback device comprises 
20 at least one of: a stereo receiver, a television audio, a home network device, a 
radio frequency network, a radio frequency based music decoder, set top box, 
and satellite radio decoder. 



17. An apparatus for unifying media services available from a plurality of 
25 content aggregators, said apparatus is of the type comprising: 

a means for receiving identifiers (202) listing media services available from 
a first content aggregator (102) from a plurality of content aggregators, 

a means for receiving identifiers (202) listing media services available from 
a second content aggregator (102) from said plurality of content aggregators, 
30 wherein said second media service list has a data structure incompatible with a 
data structure said first media service list; and 
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a means for translating (214) said first media service listing and said 
second service listing into a unified media service listing comprising media 
services available from a plurality of uniform resource locators. 

18. The apparatus of claim 17 further comprising a means for displaying 
(222) said unified media service listing. 



19. The apparatus of claim 18 further comprising: 

a means for requesting (224) a media service displayed on said unified 
media service listing; 

a means for receiving (202) said media service; and 
a means for outputting (220) said media service. 

20. The apparatus of claim 19 further comprising: 

a means for receiving (204) a second media service that is preselected; 

a means for outputting (212) said second media service, wherein said 
means for outputting (212) said second media service is different than said 
means for outputting (220) said media service. 

21 . The apparatus of claim 19 further comprising: 
a means for purchasing (224) said media service. 
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^900 

<?xfnl version ='1.0'?> 

<!-MEDIAMATCH^C0NTENUI8T-> 

<!DOCTYPEIistI 

<!ELEMENT mediaservice (location, media Jlle, playerjpp. performer, genre, copyrights 

<!ELEMENT location (ffCOATA)> 

<!ELEMENT media jlle (#PCDATA)> 

<!ELEMENT playerjpp (#PCDATA)> 

<IELEMENT performer (#PCOATA)> 

<!ELEMENT genre (#PCDATA)> 

<!ELEMENTcopyrighl(#PCDATA)> 

]> 

<lisl> 

<mediaservice> 

<locatiori>http://www.musiclesters.com/buggy/te^^ 
<mediaJitle>TravollaSwing</mediaJtle> 
<playerjpp>MP3</playerjpp> 
<perfomier>TravollaJohn</peflormer> 
<genre>Bluegrass</genr6> 
<copyrlght>ig89</copyrighb 

</mediaservice> 

<mediaservice> 

<location>121.12.113.331</location> 

<mediaJitle>The_Big_Sleep</mediaJtle> 

<playerjpp>MPEGJ</playerjpp> 

<performer>BogalHumphrey</perfomier> 

<genre>Mystery</genre> 

<copyriglit>1946</copyright> 



</m^iaservice> 
<mediaservice> 

<location>111.345.44.332</location> 

<mediaJitle>Steve_Dahl</mediaJille> 

<playerjpp>RealAudio</playerjpp> 

<perlormer>DahLSteve</performer> 

<genre>Talk.SHow</genre> 

<copyright>2001</copyright> 

</mediaservice> 

<lk\> 
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